Hopfield neural network: The hyperbolic tangent and the piecewise-linear activation functions
نویسندگان
چکیده
This paper reports two-dimensional parameter-space plots for both, the hyperbolic tangent and the piecewise-linear neuron activation functions of a three-dimensional Hopfield neural network. The plots obtained using both neuron activation functions are compared, and we show that similar features are present on them. The occurrence of self-organized periodic structures embedded in chaotic regions is verified for the two cases.
منابع مشابه
Accelerating Activation Function for 3- Satisfiability Logic Programming
This paper presents the technique for accelerating 3-Sat isfiability (3-SAT) logic programming in Hopfield neural network. The core impetus for this work is to integrate activation function for doing 3-SAT logic programming in Hopfield neural network as a single hybrid network. In logic programming, the activation function can be used as a dynamic post optimizat ion paradigm to transform the ac...
متن کاملEffects of Non-uniform Suction, Heat Generation/Absorption and Chemical Reaction with Activation Energy on MHD Falkner-Skan Flow of Tangent Hyperbolic Nanofluid over a Stretching/Shrinking Eedge
In the present investigation, the magnetohydrodynamic Falkner-Skan flow of tangent hyperbolic nanofluids over a stretching/shrinking wedge with variable suction, internal heat generation/absorption and chemical reaction with activation energy have been scrutinized. Nanofluid model is composed of “Brownian motion’’ and “Thermophoresis’’. Transformed non-dimensional coupled non-linear equations a...
متن کاملTraining of Perceptron Neural Network Using Piecewise Linear Activation Function
A new Perceptron training algorithm is presented, which employs the piecewise linear activation function and the sum of squared differences error function over the entire training set. The most commonly used activation functions are continuously differentiable such as the logistic sigmoid function, the hyperbolic-tangent and the arctangent. The differentiable activation functions allow gradient...
متن کاملMultistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions
In this paper, we investigate the exact existence and dynamical behaviors of multiple equilibrium points for delayed competitive neural networks (DCNNs) with a class of nondecreasing piecewise linear activation functions with 2rðr≥1Þ corner points. It is shown that under some conditions, the N-neuron DCNNs can have and only have ð2r þ 1Þ equilibrium points, ðr þ 1Þ of which are locally exponent...
متن کاملCorruption of Generalizing Signals in Densely Connected Feedforward Neural Networks with Hyperbolic Tangent Activation Functions
This paper discusses the propagation of signals in generic densely connected multilayered feedforward neural networks. It is concluded that the dense connecting combined with the hyperbolic tangent activation functions of the neurons may cause a highly random, spurious generalization, that decreases the overall performance and reliability of a neural network and can be mistaken with overfitting...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neural networks : the official journal of the International Neural Network Society
دوره 34 شماره
صفحات -
تاریخ انتشار 2012